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ABSTRACT 



The Reading Recovery Program, designed to help low-achieving 
first graders learn to use effective reading strategies, was fully 
implemented in the Durham, North Carolina, public schools in the 1994-1995 
school year. An evaluation was conducted to assess the effects of the program 
over time through the achievement of students in the 1994-1995 (n=167) , 
1995-1996 (n=302) , and 1996-1997 (n=314) school years. The performance of 
Reading Recovery students was compared with that of 50 randomly selected 
students who did not participate in Reading Recovery. Between 7 in 10 and 8 
in 10 students completed the program each year. Data indicate that the 
Reading Recovery program is helping significant numbers of students to read 
at or above the expected grade level . Five to 7 years after being exposed to 
Reading Recovery, students were performing within 10 to 15 percentile points 
of a comparison group of average students. The fact that a higher percentage 
of students in the comparison group were reading at or above grade level is 
not surprising, since the goal of Reading Recovery is to help the lowest 
achieving students learn to use effective reading strategies. Data also 
indicate that each successive cohort of Durham Public Schools Reading 
Recovery programs performed better than its predecessor. An appendix shows 
the scale scores associated with each achievement level on the North Carolina 
end-of -grade tests. (Contains 13 tables.) (SLD) 
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A Longitudinal Evaluation of the Long-Term Effects 
of a Reading Recovery Program 

Executive Summary 

The Reading Recovery program was designed to help low achieving first grade children learn to use 
effective reading strategies. This program was partially implemented in Durham Public Schools in the 
1992-93 year, and fully implemented by the 1994-95 year. This evaluation was conducted of Reading 
Recovery students in the 1994-95, 1995-96 and 1996-97 school years to assess the effects of the 
program over time. 

The evaluation focuses on measures of academic performance across the three school-year cohorts and 
compares the performance of Reading Recovery students with that of a group of 50 randomly students 
who did not participate in the program and represent average students in the school system. 
Exceptional Children Program status (but not whether students were in programs for academically 
gifted and talented programs) was taken into account. Due to the longitudinal nature of the design and 
the type of data used for the evaluation, there was considerable variation in rates of attrition: students 
in the intervention and comparison (average) groups who left the school system ranged from 12.8 to 
23.7 percent; and students in these groups who had incomplete data in the State’s test and management 
information systems ranged from 1 1.2 to 27.2 percent. 

1994- 1995 Cohort . During the first full implementation year, 167 students participated in the Reading 
Recovery program. Four years later, 38.5 percent of these students were enrolled at or above expected 
grade level and 41.9 percent were one or more grade levels behind (the rest were no longer in the 
school system or could not be located). Of the students in the comparison (average) group, 67.4 
percent were performing at or above expected grade level, and 18.6 percent were one or more grade 
levels behind expected grade level. Almost 7 out of every 10 students were able to successfully 
complete the Reading Recovery program. 

1995- 1996 Cohort . During the second full implementation year, 302 students participated in the 
Reading Recovery program. Three years later, 53.3 percent of these students were enrolled at or above 
expected grade level and 31.7 percent were one or more grade levels behind. Of the students in the 
comparison (average) group, 67.9 percent were enrolled at or above expected grade level, and 15.1 
percent were one or more grade levels behind. An average of more than 8 of every 10 students was 
able to successfully complete the Reading Recovery program. 

1996- 1997 Cohort . During the third full implementation year, 3 14 students participated in the Reading 
Recovery program. Two years later, 65.1 percent of these students were enrolled at or above expected 
grade level and 22.1 percent were one or more grades below expected grade level. Unfortunately, no 
comparison (average) group was available for this cohort. Again, 8 of every 10 students was able to 
successfully complete the Reading Recovery program. 



Discussion and Conclusion . The data used for this evaluation indicates that the Reading Recovery 
program is helping significant numbers of students in reading at or above expected grade levels. Five 
to seven years after having been exposed to the program, Reading Recovery students were performing 
within 10-15 percentile points of a comparison group of average students in the Durham Public 
Schools. The fact that a higher percentage of students in the comparison group was reading at or above 
grade level is not surprising, since the goal of the Reading Recovery program is to help the lowest 
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achieving children learn to use effective reading strategies. The data also indicate that each successive 
cohort of the Durham Public Schools’ Reading Recovery programs performed better than its 
predecessor. This indicates that the program was improving over time, probably due to more effective 
teacher training and to teachers becoming more experienced in working with disadvantaged students. 



A Longitudinal Evaluation of the Long-Term Effects 
of a Reading Recovery Program 



Overview of the Reading Recovery Program 

Reading Recovery is an early intervention program designed to help the lowest achieving first grade 
children learn to use effective reading strategies. By accelerating the progress of high-risk children, 
Reading Recovery provides success for young children before they enter the cycle of failure that many 
students experience even in their first year of school. Program proponents state... “We now know 
enough to guarantee that virtually every child will learn to be a good reader and writer during the first 
two years of school. ...Children’s success in school depends on quality education from the start” (Lyons, 
Pinnell, and DeFord, 1993). 

Developed by Dr. Marie Clay, a New Zealand educator and psychologist, Reading Recovery was first- 
implemented in the United States at The Ohio State University in 1984-85. Currently,, in 49 states from * 
Oregon to South Carolina, there are trained Reading Recovery teachers implementing the program in . 
more than 10,000 schools and 4,000 school systems. According to Wilson and Daviss (1994), 
“Reading Recovery has proved to be more effective and efficient at correcting reading problems than 
its competitors. In poor urban and posh suburban schools alike, the program consistently rehabilitates 
more than four of every five failing first-grade readers in just twelve to twenty weeks of daily half-hour 
lessons.” 

According to some research, through effective implementation of Reading Recovery, 80 percent of the 
lowest achieving first grade children can develop effective strategies for reading and perform at or 
above average levels of literacy in their classrooms (Hiebert and Taylor, 1994). These children become 
independent readers with internal self-extending systems of communication. By reducing retention 
rates, the need for remedial services, and special education placements, Reading Recovery can be an 
educationally sound and cost-effective early intervention program, and is widely implemented 
throughout the world (Dyer, 1992). 

Each child that enters Reading Recovery receives one-on-one daily tutoring for 12 to 20 weeks. A 
typical session includes: reading known stories, reading a story that was read one time during the 
previous session, writing a story, working with a cut-up sentence, and reading a new story. The teacher 
systematically records what the child does during each tutoring session and these observations form the 
basis for the next lesson. 

In order to become certified in Reading Recovery a teacher must complete a year-long intensive 
graduate course in the theories, practices, and procedures of effective reading instruction. As a result, 
Reading Recovery teachers view reading as a “message getting, problem solving activity that increases 
in power and flexibility the more it is practiced” (Clay, 1991). The teachers also analyze children’s 
reading and writing behaviors and build on their strengths as part of on-going instruction (Opitz, 1991). 
Teachers in Reading Recovery training participate in weekly sessions during which they observe and 
coach each other tutoring children one-on-one “behind the glass” of specially designed observation 
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classrooms. Beyond the initial year of training, Reading Recovery educators at all levels continue to 
refine their expertise by attending regular continuing contact sessions. 



Supporting Research for Reading Recovery 

Beginning in 1985 and continuing through the first three academic years of implementation, Reading 
Recovery graduates, whether attending inner city or wealthier suburban schools in Columbus, Ohio, 
scored three achievement levels above their classmates participating in other remedial programs. 
Similarly, researchers at The Ohio State University gathered statewide data on Reading Recovery 
students who successfully “discontinued” (a term that means “to successfully complete”) the program 
showing that 60 percent were reading at or above their grade averages in 4th grade, 70 percent were 
spelling with at least average ability, and more than 80 percent were in the average or better reading 
groups in their classrooms (Wilson and Daviss„.l 994). 

Also promising are the longitudinal program evaluation data from three school systems (Columbus, 
Upper Arlington, and Lancaster, Ohio) implementing Reading Recovery for at least five years. Cost- 
benefit analyses comparing Reading Recovery with alternative interventions for high-risk first grade 
students indicate that these school districts will save money considerably by: 1) reducing the number of 
first grade retentions; 2) avoiding special education testing and diagnostic practices (which often lead 
to misclassification and placement of children in LD programs); and 3) reducing the number of 
students assigned to long-term remedial reading or alternative education programs (Lyons and Beaver, 
1995). 

A case study of Upper Arlington’s implementation of Reading Recovery indicates that the program is 
most successful when it involves the training and support of classroom teachers, especially those 
teaching kindergarten, first and second grade classes. “No special program can be as effective as it 
might be until classroom instruction is exemplary” (Allington and Cunningham, 1996). By combining 
the efforts of Reading Recovery teachers, specialists, and classroom teachers, Upper Arlington Schools- 
dramatically reduced the number of retentions in the early grades and referrals for special educations 
services. 

While both advocates of phonics and whole language instruction are quick to claim Reading Recovery 
as another example of their achievements. Marie Clay insists that “this isn’t part of whole language.” 
Most experts in the field of reading instruction agree that “Reading Recovery’s success is due to its 
shrewd combination of teaching strategies from different pedagogical camps, including the use of 
phonics” (Levine, 1994). 



Implementation of Reading Recovery in Durham Public Schools 

A. long-term commitment to the improvement of reading within the Durham (NC) Public Schools led 
to the development of a Literacy Study Group. In 1994, this group articulated its goals: 

“All children come to school ready to continue their progress in literacy development. The 
schools’ role is to provide ongoing, informal assessment that informs and promotes 
literacy instruction and builds o.n students’ strengths and interests. Our goal is that the 
learners in Durham Public Schools will become confident, lifelong readers through 
literacy development.” 
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With the leadership of Dr. Christopher Baker from Salem College in Winston-Salem, North Carolina, 
six central office administrators, six teachers, and three principals forged a system-wide literacy plan 
based on the above-stated beliefs and goal. The Literacy Study Group also defined reading to be: 

• a complex, active process 

• meaning-seeking and meaning-creating 

• problem-solving and risk-taking 

• the use of a variety of cueing systems and strategies that develop with practice 

• dependent on attitudes and interests that need to be recognized and respected 

Reading Recovery in Durham Public Schools has used a combination of Title 1 and local funding to 
provide trained Reading Recovery teachers to tutor first graders in elementary schools. Dr. Deborah 
Pitman, Director of Elementary Education, serves as the Reading Recovery Site Coordinator. She also 
has made arrangements with North Carolina Central University to offer six hours of graduate credit for 
teachers in Reading Recovery training through Durham Public Schools; moreover, the DPS Teacher 
Leaders serve as adjunct professors at NCCU. 

Durham Public Schools initiated Reading Recovery in the 1992-93 school year by training two DPS 
teachers-Mary Clayton and Debbie Scheffe--in Wilmington, North Carolina. That same year, these 
teachers tutored twelve first graders as they piloted Reading Recovery. During the next school year, 
1993-94, Durham Public Schools committed to training two Teacher Leaders (Mary Clayton and, 
Cassandra Yongue) at UNC-Wilmington. Having two Teacher Leaders facilitates reaching full 
program implementation as quickly as possible by providing effective literacy instruction for the lowest 
20 to 30 percent of the first grade population. 

In 1993-94, four other teachers received Reading Recovery training in Halifax, Virginia. This enabled 
thirty first grade students to receive Reading Recovery instruction. In 1994-95 the two Teacher 
Leaders and five trained Reading Recovery teachers, as well as the 18 teachers in training, were able to 
serve a total of 163 first grade children. 

During the 1995-96 school year more than 300 first graders received Reading Recovery instruction 
from 34 teachers who were trained in Durham Public Schools. In 1998, Durham Public Schools made 
a commitment to full implementation of the Reading Recovery program by providing one locally- 
funded Reading Recovery teacher for each 50 first grade students in each elementary school through 
the DPS Literacy Initiative. Consequently, the number of students served rose sharply in 1998-99 due 
to a large increase in the number of trained teachers and teachers-in-training. Presently, more than 600 
first grade students are served by the Reading Recovery program each year in Durham Public Schools. 



Observation Survey of Early Literacy Achievement 

The Observation Survey of Early Literacy Achievement (Clay, 1993) is the major assessment 
instrument used in the Reading Recovery Program. (For convenience, we will usually refer to this as 
the Observation Survey in our discussion.) Teachers in Reading Recovery can use the Observation 
Survey to assess each child’s strengths in: Letter Identification, Concepts About Print, Word Test, 
Writing Vocabulary, Dictation Task, and Text Reading Level. 

As indicated by the research cited previously, to be most effective Reading Recovery must be 
supported by children’s classroom instruction. All first grade teachers in Durham Public Schools have 
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received training on the use of Clay’s Observation Survey to assess children’s strengths and needs in 
their, literacy development. During the 1995-96 school year these assessments were shared with 
parents during conferences and compiled systemwide by the Office of Elementary Instructional 
Outcomes. 

Children’s individual profiles were given to their second grade teachers in 1996-97 to provide 
information about each child’s growth in reading and writing. Plans are now under way to provide 
second grade and kindergarten teachers with similar training in using the Observation Survey so that 
all DPS elementary schools can document and assess young children’s continuous progress in literacy 
development through the early childhood grades (K-2). Such consistent, systemic staff development is 
necessary to attain the goal of assuring that all students in Durham Public Schools become confident, 
lifelong readers. 



K-2 Assessment Program 

The K-2 Assessment Program in Durham Public Schools was initiated in 1 994-95, the first full year of 
implementation of the Reading Recovery Program. Although subsequently modified as to when 
particular tasks are to be administered, this program calls for administration of selected tasks of the 
Obsemation Survey at selected times (no more than once each quarter), depending upon grade level 
and previous student performance on a particular task. The fall administration of this K-2 Assessment 
Program provides data for a common starting point for the evaluation of both Reading Recovery and 
non-Reading Recovery students. 



Focus of Evaluation 

This evaluation focuses on the first three years of full implementation of the Reading Recovery 
Program in Durham Public Schools. As shown previously in Table I, the students who received 
Reading Recovery services in these years (1994-95, 1995-96, and 1996-97) and have stayed on grade 
level (i.e., have not repeated a grade level) should now be seventh, sixth, and fifth grade students, 
respectively. The success of these three cohorts of Reading Recovery students is compared with the 
success of a random sample group 1 of 50 students each year, who also are tracked over the ensuing 
years. Unfortunately, the list of random sample group students was not available for the 1996-97 
cohort, so only Reading Recovery students for that year have been tracked in this report. The results 
for these Reading Recovery cohort and random sample groups of students are presented in the 
following sections of this report. 



1994-95 Cohort 

In 1994-95, the first year of full implementation of the Reading Recovery Program in Durham Public 
Schools, 167 first grade students received Reading Recovery services. In addition, there were 48 
students in the random sample group. For both the Reading Recovery and random sample students for 
the 1994-95 school year, their progress across grade levels in school is presented in Table II. 




1 This random sample group was selected as part of a data reporting requirement to the Ohio State University as 
part of the obligation of being an official Reading Recovery site. Unlike the Reading Recovery students, who 
are the neediest students educationally, these random sample group students represent the average student in 
Durham Public Schools and purposely exclude any Reading Recovery students. 
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